The Entropy Photon-Number Inequahty and its Consequences* 
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Determining the uhimate classical information carrying capacity of electromagnetic waves requires 
quantum-mechanical analysis to properly account for the bosonic nature of these waves. Recent work 
has established capacity theorems for bosonic single-user, broadcast, and wiretap channels, under 
the presumption of two minimum output entropy conjectures. Despite considerable accumulated 
evidence that supports the validity of these conjectures, they have yet to be proven. Here we show 
that the preceding minimum output entropy conjectures are simple consequences of an Entropy 
Photon-Number Inequality, which is a conjectured quantum-mechanical analog of the Entropy Power 
Inequality from classical information theory. 



I. MOTIVATION AND HISTORY 

The performance of communication systems that rely 
on electromagnetic wave propagation are ultimately lim- 
ited by noise of quantum-mechanical origin. Moreover, 
high-sensitivity photodetection systems have long been 
close to or at this noise limit, hence determining the ul- 
timate capacities of lasercom channels, which requires 
quantum-mechanical analysis, is of immediate relevance. 
The most famous channel capacity formula is Shannon's 
result for the classical additive white Gaussian noise 
channel. For a complex-valued channel model in which 
we transmit a and receive c = a + ^/l — rj b, where 
< 77 < 1 is the channel's transmissivity and 6 is a 
zero-mean, isotropic, complex-valued Gaussian random 
variable that is independent of a. Shannon's capacity is 

Cciassicai ln[l + riN/{l - 'q)N] nats/use, (1) 

with E{\a\'^) < N and E{\b\'^) = N. In the quantum 
version of this channel model, we control the state of an 
electromagnetic mode with photon annihilation operator 
a at the transmitter, and receive another mode with pho- 
ton annihilation operator c = ^/rj a + y^l — rj b, where b 
is the annihilation operator of a noise mode that is in 
a zero-mean, isotropic, complex-valued Gaussian state. 
For lasercom, if quantum measurements corresponding 
to ideal optical homodyne or heterodyne detection are 
employed at the receiver, this quantum channel reduces 
to a real-valued (homodyne) or complex-valued (hetero- 
dyne) additive Gaussian noise channel, from which the 
following capacity formulas (in nats/use) follow: 

Chomodync = ^Hl + At^N / {2{1 - 1^) N + 1)] (2) 



heterodyne 



+ 2r]N/{{l - rj)N + I)]. 



(3) 



The -|- 1 terms in the capacity formulas' noise denomina- 
tors are quantum noise contributions, so that even when 
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the noise mode b is unexcited — in its vacuum state — these 
capacities remain finite, unlike the situation in Eq. ([T]). 

The classical capacity of the pure-loss bosonic 
channel — in which the b mode is unexcited (N — 0) — was 
shown in [l| to be Cpure-ioss = giv^) nats/use, where 
g{x) = (x+l) ln(a:-|-l) — zln(2:) is the Shannon entropy of 
the Bose-Einstein probability distribution with mean x. 
This capacity exceeds the iV = versions of Eqs. ([2]) and 
([3]), as well as the best known bound on the capacity of 
photon-number measurement (ideal optical direct detec- 
tion). The ultimate capacity of the thermal- noise {N > 
0) version of this channel was considered in [2] , where the 
lower bound Cthormai > givN + (1 - - .g((l - r])N) 
was shown to be the capacity if the thermal channel 
obeyed a certain minimum output entropy conjecture. 
This conjecture states that the von Neumann entropy at 
the output of the thermal channel is minimized when the 
a mode is in its vacuum state. Several partial results, nu- 
merical evidence, and a suite of upper and lower bounds 
were obtained to support the conjecture [3j|, but it has yet 
to be proven. Nevertheless, the preceding lower bound 
already exceeds Eqs. and ^ as well as the best known 
bounds on the capacity of direct detection. 

The thermal channel work was followed by a capac- 
ity analysis of the bosonic broadcast channel, for which 
we obtained an inner bound on the capacity region [4|, 
which we showed to be the capacity region under the 
presumption of a second minimum output entropy con- 
jecture that was a dual to the first. Both conjectures have 
been proven if the input states are restricted to be Gaus- 
sian, and we have shown that they are equivalent under 
this input-state restriction. In unpublished work we 
have shown that the second conjecture will establish the 
privacy capacity of the lossy bosonic channel, as well as 
its ultimate quantum information carrying capacity. 

The Entropy Power Inequality (EPI) from classical in- 
formation theory is widely used in coding theorem con- 
verse proofs for Gaussian channels. By analogy with the 
EPI, we conjecture its quantum version, viz., the Entropy 
Photon- number Inequality (EPnl) . In this paper we show 
that the two minimum output entropy conjectures cited 
above are simple corollaries of the EPnI. Hence, proving 
the EPnl would immediately establish key results for the 
capacities of bosonic communication channels. 
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II. DESCRIPTION OF THE PROBLEM 

A. The Entropy Power Inequality 

Let X and Y be statistically independent, n- 
dimensional, real- valued random vectors that possess dif- 
ferential (Shannon) entropies /i(X) and /i(Y) respec- 
tively. Because a real-valued, zero-mean Gaussian ran- 
dom variable U has differential entropy given by h{U) — 
ln(27re(t/^)), where the mean-squared value, (/7^), is con- 
sidered to be the power of U, the entropy powers of X 
and Y are taken to be 



P(X) 



27re 



and P(Y) 



j/i(Y)/n 

27re 



(4) 



In this way, an n-dimensional, real-valued, random vec- 
tor X comprised of independent, identically distributed 
(i.i.d.), real-valued, zero-mean, variance-P(X), Gaussian 
random variables has differential entropy ^(X) = ft,(X). 
We can similarly define an i.i.d. Gaussian random vector 
Y with differential entropy h{Y) = h{Y). We define a 
new random vector by 



Z = V^X+yi^Y, 



(5) 



where < rj < 1. This random vector has differential 
entropy /i(Z) and entropy power /'(Z). Furthermore, let 
Z = Y^X -I- ^yl — rjY. Three equivalent forms of the 
Entropy Power Inequality (EPI), see, e.g., [6], are then: 

P(Z) > 77P(X) + (1 - 77)P(Y) (6) 
h{Z) > h{Z) (7) 
h{Z) > 7]h{X) + {l-rj)h{Y). (8) 

B. The Entropy Photon-Number InequaHty 

Let a — [ di 0,2 ■ ■ • a„ ] and b = [bi &2 ■ • • bn] 
be vectors of photon annihilation operators for a collec- 
tion of 2n different electromagnetic field modes of fre- 
quency to Q- The joint state of the modes associated 
with a and b is assumed to be the product-state den- 
sity operator pab — Pa ® Pb, where pa and pb are the 
density operators associated with the a and b modes. 
The von Neumann entropies of the a and b modes are 
S{,Pa.) = -tr[/5a In(pa)] and S{pb) = -ty[pb^n[pb)] [8]. 

The thermal state of a mode with annihilation operator 
d has two equivalent forms 



Pt 



a ■ 



and 



ttN 



\a){al 



(9) 



(10) 



where N = (at a) is the average photon number. In 
Eq. ([9]), \a) is the coherent state of amplitude a, i.e., 
it satisfies d\a) = a\a), for a a complex number. In 
Eq. (fTU)) . \i) is the i-photon state, i.e., it satisfies N\i) — 
for i = 0,1,2,..., with N = a^d being the pho- 
ton number operator. Physically, Eq. ^ says that the 
thermal state is an isotropic Gaussian mixture of coher- 
ent states. Equation PH)) . on the other hand, says that 
the thermal state is a Bose-Einstein mixture of num- 
ber states. From Eq. pH)) we immediately have that 
S{pt) — 9i-^-L because the photon- number states are 
orthonormal (9[. Note that ^(TV), for iV > 0, IS a non- 
negative, monotonically increasing, concave function of 
N. Thus it has an inverse, §'-^{3), for S > 0, that is 
non-negative, monotonically increasing, and convex. 

The entropy photon-numbers of the density operators 
Pa and Pb are defined as follows: 

N{pa) = g-\Sipa)/n) and N{pb) = g-\Sipb)/n). 

(11) 

Thus, if Pa = /5t„. and = 0"^^ pr^. , where pr,^ 

is the thermal state of average photon number N{pa) for 
the di mode and pTf,. is the thermal state of average pho- 
ton number N{pb) for the hi mode, then we have S{pa) = 
S{pa) and S{pf^) — S{pb)- We define a new vector of pho- 
ton annihilation operators, c = [ ci C2 • • • c„ ], by 



c = y^d + -y/l — 776, for < 77 < 1, 



(12) 



and use pc to denote its density operator. This is equiv- 
alent to saying that Ci is the output of a lossless beam 
splitter whose inputs, di and bi, couple to that output 
with transmissivity rj and reflectivity 1 — 77, respectively. 

We can now state two equivalent forms of our conjec- 
tured Entropy Photon- Number Inequality (EPnl) jlOl |: 

N{M > vN{pa) + i^-v)N{pb) (13) 

SiM > Sip-,), (14) 

where p, = ^^^iPt^. with px^ being the thermal state 
of mean photon number r]N{pa) -|- (1 — r])N(pb) for 

III. PRIOR WORK AND DISCUSSION 

By analogy with the classical EPI, we might expect 
there to be a third equivalent form of the quantum EPnl, 
viz.. 



Sip.)>vS{pa) + il-v)S{pb). 



(15) 



It is easily shown that Eq. (|T3)l implies Eq. (|T5)) , but 
we have not been able to prove the converse. Indeed, we 
suspect that the converse might be false. More impor- 
tant than whether or not is equivalent to Eq. IT^ 
and Eq. p4|) . is the role of the EPnl in proving classical 
information capacity results for bosonic channels. In par- 
ticular, the EPnl provides simple proofs of the following 
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two minimum output entropy conjectures. These con- 
jectures are important because proving minimum output 
entropy conjecture 1 also proves the conjectured capacity 
of the thermal- noise channel 0, and proving minimum 
output entropy conjecture 2 also proves the conjectured 
capacity region of the bosonic broadcast channel 

Minimum Output Entropy Conjecture 1 — Let 
a and b be n-dimensional vectors of annihilation opera- 
tors, with joint density operator pab — {\i})aa{i'\) ® Pb, 
where \'ip)a is an arbitrary zero- mean- field pure state of 
the a modes and pb = ®^=iPTb. with pT^. being the 

hi mode's thermal state of average photon number K . 
Define a new vector of photon annihilation operators, 
c = [ ci C2 • • ■ c„ ] , by and use pc to denote its 
density operator and S{pc) to denote its von Neumann 
entropy. Then choosing \4^)a to be the rt-mode vacuum 
state minimizes S{pc)- 

Minimum Output Entropy Conjecture 2 — Let 
a and b be n-dimensional vectors of annihilation opera- 
tors, as in the previous section, with joint density opera- 
tor Pab = i\lp)aa{i^\)(E)Pb, whcrC |l/')a = 

71-mode vacuum state and pb has von Neumann entropy 
S{pb) — ng{K) for some K > 0. Define a new vector 
of photon annihilation operators, c = [ ci £2 • • • c„ ], 
by (|12p and use pc to denote its density operator and 
S{pc) to denote its von Neumann entropy. Then choos- 
ing Pb = {^'"=1 PTb with pTf,. being the hi mode's thermal 
state of average photon number K minimizes S{pc)- 



To see that the EPnl encompasses both of the preced- 
ing minimum output entropy conjectures is our final task 
in this paper. We begin by using the premise of conjec- 
ture 1 in Eq. Because the a modes are in a pure 
state, we get S{pa) = and hence the EPnl tells us that 

N{p,)>{l-7j)N{pb) = {l-v)K. (16) 

Taking g(-) on both sides of this inequality, we get 
S{pc)/n > g[{l — ri)K]. But, if !■(/;)„ is the n-mode vac- 
uum state, we can easily show that pc = {^'"=1 PTa , with 
PTa being the Ci mode's thermal state of average photon 
number (1 — ri)K. Thus, when \ip)a is the n-mode vac- 
uum state we get S{pc) — '^^[(l ~ v)^]i which completes 
the proof. 

Next, we apply the premise of conjecture 2 in Eq. (|13p . 
Once again, the a modes are in a pure state, so we get 

N{p,)>{l-7j)N{pb)^{l-v)K, (17) 

and hence S{pc)/n > g[{l — r])K]. But, taking pb = 

^7=1 PTb , with pTfc. being the hi mode's thermal state 
of average photon number K, satisfies the premise of 
minimum output entropy conjecture 2 and implies that 
Pc — ®i=i Pt^ 1 with pt^, being the Ci mode's thermal 
state of average photon number (1 — rj)K . In this case we 
have S{pc) = ng[{l — ri)K], which completes the proof. 
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is pc = ^"^iPTa , where px^, is a thermal state with 
average photon number given by N{pc) = r]N{pa) 4- (1 — 
ri)N{p^), so that S{pc) = ng[N{pa)]. Thus, from JTH) we 
get N{pc) > Nipz) = g~^{S{pa)/n). Taking g{-) of both 
sides of this inequality completes the proof. 
To show that p4|) implies (|13p . assume (|14|l is true: 

N{pc) = g-\S{M/n) 

> g-\S{pa)/n) = g-'[g{vN{p^) + (1 - v)N{p6))] 

= vN{pa) + {l-v)N{p6) 

= r,iV(p„) + (l-r,)iV(p5), (20) 

where the inequality is due to g~^{S) being a monotoni- 
cally increasing function of S, and the proof is complete. 
[11] Assume that (|13|l is true. We then have that N{pc) > 
rjN{pa.) + (1 - ri)N{pb), so that 

SiM = ng[N{pc)]>ng[7^N{M + {l~ri)N{pt)] (21) 
> vn9[Nip^)] + il-r,)ng[N{M] (22) 

= vS{M + {^-V)Sipb), (23) 

where the second inequality follows from g{N) being con- 
cave, and the proof is complete. 



